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ABSTRACT: 

In a reproduction apparatus, for reproducing an original signal conveyed as main data by a data 
medium such as a recording disk or broadcasting system, with medium protection data which are 
specific to the data medium being conveyed together with the main data, the apparatus includes 
a section (12) for generating apparatus protection data which are specific to the reproduction 
apparatus, a section (13) for combining the apparatus protection data with the medium 
protection data to define a protection level, and a section (14) for applying the protection level to 
restrict reproduction of of the original signal, with stepwise variations in restriction occurring in 
accordance with changes in protection level. The medium protection data may include 
information for specifying restricted reproduction of portions of the original signal, such as by 
producing degraded resolution within specified regions of specified frames of a video signal. 
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(si) Method for restricting data reproduction. 

(S?) In a reproduction apparatus, for reproducing 
an original signal conveyed as main data by a 
data medium such as a recording disk or broad- 
casting system, with medium protection data 
which are specific to the data medium being 
conveyed together with the main data, the ap- 
paratus includes a section (12) for generating 
apparatus protection data which are specific to 
the reproduction apparatus, a section (13) for 
combining the apparatus protection data with 
the medium protection data to define a protec- 
tion level, and a section (14) for applying the 
protection level to restrict reproduction of of 
the original signal, with stepwise variations in 
restriction occurring in accordance with 
changes in protection level. The medium pro- 
tection data may include information for speci- 
fying restricted reproduction of portions of the 
original signal, such as by producing degraded 
resolution within specified regions of specified 
frames of a video signal. 
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BACKGROUND OF THE INVENTION 



Field of the Invention 



The present invention relates to a data reproduc- 
tion protection method, and a data reproduction ap- 
paratus for implementing such a protection method, 
whereby reproduction of a signal represented by dig- 
ital data such as a recorded digital video signal can be 
selectively restricted. 

Description of the Prior Art 

In the following, the term "data medium" is to be 
understood in a very general sense, as applying for 
example to broadcasting systems which transmit data 
such as video and/or audio data, in which case the re- 
ceived data may be the object of reproduction protec- 
tion, and as applying also to any type of recording me- 
dium such as recording disks or tapes, etc., in which 
case playback data derived from the recording me- 
dium may be the object of reproduction protection. 
The reproduction protection may serve to selectively 
restrict viewing, hearing or copying of the data. 

In the prior art, various types of reproduction pro- 
tection method have been applied in fields such as 
CATV (cable television) and satellite television broad- 
casting. One method is to execute scrambling proc- 
essing of transmitted video and audio data, and to in- 
sert a copyright code into the data, for thereby divid- 
ing the data into portions which can be freely repro- 
duced and portions for which a fee must be paid in or- 
der to reproduce the data. When a program for which 
payment of a fee is necessary is received by a receiv- 
ing apparatus, the program can be unscrambled and 
reproduced only if specified payment conditions are 
satisified. 

In the case of recorded media, one method of re- 
production protection which is applicable to the DAT 
(digital audio tape recorder) recording system is the 
SCMS (serial copy management system). With that 
method, the playback DAT signal from a DAT play- 
back apparatus has a main ID (identification) number 
which includes a copy inhibit code, whereby a single 
[copy enable - copy inhibit] sequence is ensured, so 
that a user can only make a single copy of a pre-re- 
corded digital audio tape. 

However with such prior art methods of reproduc- 
tion protection there are only two control possibilities, 
i.e. reproduction is made either possible or impossi- 
ble, ft has not been possible hitherto to provide a grad- 
ually varying degree of restriction of reproduction of 
a signal conveyed by a data medium. Thus, such a re- 
production protection method can only be used for a 
single purpose, e.g. for management of paymentfees, 
or for copyright protection. Moreover with such a prior 
art reproduction protection method, since the data 
which are to be protected exist only in a transmitting 



medium or recording medium prior to being repro- 
duced, it has not been possible to provide a varying 
degree of limitation of reproduction capability in ac- 
cordance with some condition of the reproduction ap- 

5 paratus. Thus in some cases, the degree of protection 
may be excessively severe, or excessively lax, so that 
it is difficult to achieve an effective degree of protec- 
tion. For example, certain types of scenes recorded 
on a video tape may be permitted to be viewed in a 

w certain country, such as the U.S.A., but may not be 
permissible in other countries. It would be thus advan- 
tageous to ensure that when that video tape is played 
on a reproduction apparatus which is sold to the pub- 
lic in such other countries, reproduction protection is 

15 automatically applied such that the aforementioned 
scenes will not be reproduced, or will not be clearly 
reproduced. However in the prior art, such a feature 
has not been possible. 

20 SUMMARY OF THE INVENTION 

It is an objective of the present invention to over- 
come the problems of the prior art set out above, by 
providing a reproduction protection method and appa- 
25 ratus whereby information specifying a degree of re- 
striction of reproduction of an original signal is con- 
veyed (e.g. by a recording medium or signal transmis- 
sion medium) together with data expressing the orig- 
inal signal, whereby information specifying a degree 
30 of restriction of reproduction of the original signal are 
generated by a reproduction apparatus which oper- 
ates on the conveyed data, and whereby information 
specifying a degree of restriction which is actually ap- 
plied to reproduction of the original signal is derived 
35 based on a combination of the restriction information 
conveyed by the data medium and the restriction in- 
formation generated by the reproduction apparatus. 

More specifically, the invention provides a repro- 
duction protection method comprising: 
40 attaching medium protection data to main data 

which are conveyed by a data medium, said main data 
representing an original signal; 

supplying the main data and medium protec- 
tion data, via the data medium, to a reproduction ap- 
45 paratus; 

generating apparatus protection data by the 
reproduction apparatus; 

determining a protection level by combining 
the medium protection data and the apparatus pro- 
se tection data; and 

controlling the reproduction apparatus to util- 
ize the main data to reproduce the original signal in 
accordance with the protection level. 

It is a further objective of the invention to over- 
55 come the above problems by providing a reproduction 
apparatus providing reproduction protection, for oper- 
ating on main data representing an original signal and 
medium protection data expressing a medium protec- 
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tion level, said main data and medium protection be- 
ing conveyed by a data medium, the apparatus com- 
prising: 

means for detecting said medium protection 
data to obtain a medium protection signal expressing 5 
said medium protection level; 

means for generating an apparatus protection 
signal expressing an apparatus protection level which 
has been assigned to said reproduction apparatus; 

means responsive to said medium protection to 
signal and apparatus protection signal for determin- 
ing a final protection level in accordance with a com- 
bination of said medium protection level and appara- 
tus protection level; 

means for executing reproduction of said orig- 15 
inal signal by utilizing said main data, including 
means for selectively restricting said reproduction in 
accordance with said final protection level. 

With such a method and apparatus for reproduc- 
tion protection, the protection level can determined in 20 
accordance with the medium protection data, and 
hence can be determined in accordance with the 
wishes of the manufacturer of the data medium, or of 
the copyright owner of the main data. In addition, the 
protection level which is actually applied (i.e. the final 25 
protection level) is also determined in accordance 
with the apparatus protection data, which can be spe- 
cified by the manufacturer or the seller of the repro- 
duction apparatus. As a result, when the main data 
are to be reproduced (for example, during playback of 30 
a recording disk or tape), a graduated degree of lim- 
itation of reproduction is implemented, with that de- 
gree of limitation being determined by the final protec- 
tion level, i.e. being determined in accordance with a 
combination of the requirements of the data medium 35 
manufacturer or the copyright owner of the main data 
and the requirements of the manufacturer or seller of 
the reproduction apparatus. In that way, considerable 
flexibility can be ensured in selectively restricting re- 
production of signals which are conveyed for example 40 
by recording disks or tapes or by broadcasting sys- 
tems. 

In particular, the invention enables such repro- 
duction restriction to be applied to specific frames or 
sequences of frames of a video signal, or to specific 45 
regions within each of a sequence of frames. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a general system block diagram of a first so 
embodiment of the invention, which is a CD play- 
er providing reproduction protection in accor- 
dance with the present invention, for use in de- 
scribing the basic principles of the invention; 
Fig. 2 is a matrix diagram showing an example of 55 
how final protection levels are determined in a re- 
production apparatus according to the present in- 
vention; 



Fig. 3 shows specific examples of how medium 
protection levels can be assigned; 
Fig. 4 shows specific examples of how apparatus 
protection levels can be assigned; 
Fig. 5 is a general system block diagram of a sec- 
ond embodiment, which is a specific configura- 
tion for the apparatus of Fig. 1, wherein protec- 
tion control is applied to a data decompression 
section; 

Fig. 6 shows examples of relationships between 
final protection level values and video picture vis- 
ibility grades, for three different methods of pro- 
tection control of a video signal; 
Fig. 7 is a general system block diagram of a third 
embodiment, which is a specific configuration for 
the apparatus of Fig. 1 , wherein protection con- 
trol is applied to a video reproduction control sec- 
tion; 

Fig. 8 is a conceptual diagram for describing how 
time-axis protection and spatial-domain protec- 
tion control can be applied to a video signal with 
the present invention; 

Fig. 9 is a diagram for describing how video, audio 
and protection data can be conveyed in a data 
stream in accordance with the MPEG1 stan- 
dards; 

Fig. 1 0 is a block diagram of an example of the in- 
ternal configuration of a video reproduction con- 
trol section in the embodiment of Fig. 7; 
Fig. 11 is a general system block diagram of a 
fourth embodiment which is a specific configur- 
ation for the apparatus of Fig. 1, wherein protec- 
tion control is applied to a video reproduction 
control section and also to an audio reproduction 
control section; 

Fig. 12 shows examples of relationships between 
final protection level values and audio signal au- 
dibility grades, for three different methods of pro- 
tection control; 

Fig. 13 is a block diagram of an example of the in- 
ternal configuration of an audio reproduction con- 
trol section in the embodiment of Fig. 11 ; 
Fig. 14 is a matrix diagram for illustrating how va- 
riable ranges can be defined for final protection 
level values, by a fifth embodiment of the inven- 
tion; 

Fig. 15 is a general system block diagram of the 
fifth embodiment, wherein a final protection level 
can be modified by operation of a switch provided 
on the reproduction apparatus; and 
Fig. 16 shows relationships between medium 
protection level values and settings of a modifh 
cation switch in the embodiment of Fig. 15, for 
each of respective values of the apparatus pro- 
tection level. 
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DESCRIPTION OF PREFERRED EMBODIMENTS 

Embodiments of the invention will now be descri- 
bed, in which the data medium is assumed to be a re- 
cording medium, specifically a CD (compact disk), 5 
having video and audio signal data recorded thereon. 
In the following, such data representing original sig- 
nals which are to be reproduced from the data me- 
dium will be referred to in general as the main data, 
to distinguish these from protection data, which are 10 
also conveyed by the data medium as described here- 
inafter. It will further be assumed that the original vid- 
eo and audio signals have been encoded by high- 
efficiency compression encoding using the MPEG1 
algorithm, prior to recording. The MPEG1 algorithm is 1 s 
described for example in "International Standards for 
Multimedia Encoding", edited by Yasuda, published 
by the Maruzen company in Japan. Fig. 1 is a diagram 
for describing the general features of the reproduction 
protection method and reproduction protection appa- 20 
rat us. 

Protection Information Provided on Recording 
Medium 

25 

The concept of medium protection data will first 
be described, referring to Fig. 1, in which data record- 
ed on a CD (compact disk) 1 are read out from the disk 
to obtain an input signal for a demultiplexer 10 of a CD 
player 2, which is shown in block diagram form and 30 
which is configured to provide reproduction protection 
control in accordance with the present invention. The 
CD 1 has video and audio signals recorded thereon 
as digital data (referred to in the following as the main 
data), using MPEG1 compression encoding. Protec- 35 
tion data, which are predetermined in accordance 
with the contents of the main data and will be referred 
to as the medium protection data, are also recorded 
on the CD 1. The medium protection data consist of 
information to be used in selectively restricting repro- 40 
duction of the main data, as described hereinafter. 
The medium protection data can for example be re- 
corded within the main code and sub-code header re- 
gions of the CD 1, or in the user region of the com- 
pressed data. The medium protection data expresses 45 
a protection level, referred to as the medium protec- 
tion level, which can for example take values which 
successively increase in five steps, from 1 to 5, as 
shown in Fig. 2 and described hereinafter. In that 
case, the medium protection data can express the so 
medium protection level by 3 bits. If separate medium 
protection levels are provided for the recorded video 
and audio data, then these can be expressed by two 
sets of 3 bits. The higher the number of the medium 
protection level, the greater is the degree of protec- 55 
tion (i.e. the greater becomes the degree of restriction 
of reproduction of the recorded video or audio signal). 
The limitation of reproduction can for example by ef- 



fected, in the case of video data, by operating on the 
playback data obtained from the CD1 such as to pro- 
duce an output video signal, from the apparatus of 
Fig. 1 which will result in a mosaic pattern being pro- 
duced within all or a specific region of a resultant dis- 
played picture, as described hereinafter. 

The medium protection level which is expressed 
by the medium protection data is predetermined in ac- 
cordance with the wishes of the manufacturer or sell- 
er of the data medium (CD 1 ) t or of the owner of the 
copyright for the main data. Fig. 3 shows two exam- 
ples of medium protection data, each expressing 5 
values of medium protection level. In the first exam- 
ple, limitation of reproduction is based upon the film 
classification system (i.e. movie ratings system) 
which is used in theU.S.A. In the case of a film which 
is rated "free", no restriction on reproduction is im- 
posed by the medium protection data. If the movie is 
rated "PG" (i.e. parental guidance), then a moderate 
degree of restriction (protection level 1) is applied, 
and so on with increasing degrees of restriction for 
the "R" and "X" ratings. In the second example, limit- 
ation of reproduction is based on the rights of the 
copyright owner, providing successively increasing 
degrees of restriction of re product ion as the protec- 
tion level increases from 1 to 5. 

The medium protection data is a combination of 
data for expressing at least one medium protection 
level as described above, and protection position in- 
formation which specifies the position (within the en- 
coded main data) at which the protection is to be ap- 
plied. It is an essential feature of the present invention 
that the medium protection data can assign the me- 
dium protection level in units of frames of the video 
signal. That is to say, limitation of reproduction of in- 
dividual frames can be controlled. In addition, limita- 
tion of reproduction of one or more specific regions 
within a specific frame (or sequence of specific 
frames) can also be predetermined by the medium 
protection data. In that case, for example, a region 
formed of a number of fixed-size blocks of pixels can 
be converted to a blank region, or filled with a mosaic 
pattern, in the final display picture that is obtained 
from the output video signal from the apparatus of 
Fig. 1. That is to say, the protection position informa- 
tion can be used to specify not only a specif ic frame, 
but also to specify one or more specific regions within 
a frame. 

Alternatively, the protection position information 
can specify an identical medium protection level for 
the entirety of each of a succession of video signal 
frames, or specify an identical medium protection lev- 
el for one or more specific regions within each of a 
succession of frames. 

The term "protection position information" is used 
here, since it may not be necessary to record explicit 
data constituting the protection position information 
on the CD 1 . Instead, that information can be inherent- 
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ly constituted by the positions at which respective me- 
dium protection data are located within the stream of 
compressed encoded main data that have been re- 
corded on the CD 1 . For example, the apparatus may 
be configured such that if the encoded data for a vid- s 
eo signal frame are immediately preceded by a por- 
tion of medium protection data, then that indicates 
that the medium protection data portion is to be ap- 
plied to that frame. If the medium protection data por- 
tion is to be applied to one or more regions within that 10 
frame, rather than the entire frame, then the medium 
protection data portion which immediately precedes 
the compressed encoded frame in the recorded data 
can include at least two values for each of these re- 
gions, for specifying the respective positions of the 1 s 
regions. In that case, explicit protection position infor- 
mation must be recorded as data on the CD 1 , as part 
of the medium protection data. 



Protection Information Generated by Reproduction 
Apparatus 



20 



With the method and apparatus of the present in- 
vention, a reproduction apparatus can be configured 
to produce predetermined protection data which are 25 
specific to that reproduction apparatus. For example, 
the CD 1 in Fig. 1 is played by a reproduction appa- 
ratus 2 which is provided with a preset table memory 
device which will be assumed to be a ROM (read-only 
memory) which generates apparatus protection data 30 
expressing a protection level referred to in the follow- 
ing as an apparatus protection level. The apparatus 
protection level is specified beforehand by the man- 
ufacturer or the seller of the reproduction apparatus. 
I n the same way as for the medium protection data de- 35 
scribed above, the apparatus protection level can 
take a plurality of values, corresponding to respec- 
tively different degrees of limitation of reproduction of 
main data which are obtained from a data medium. It 
will be assumed that the number of apparatus protec- 40 
tion level values is 4, i.e. from 1 to 4, so that the ap- 
paratus protection data can be consist of two bits. 
The higher the apparatus protection level number, the 
greater becomes the degree of protection, i.e. the 
greater becomes the degree of reproduction limita- 45 
tion. 

The contents of the apparatus protection data 
ROM cannot be rewritten by the user. In the embodi- 
ment of Fig. 1 , each time that power to the apparatus 
is switched on, the apparatus protection data are read so 
out from the ROM, and thereafter reproduction is exe- 
cuted in accordance with a combination of the appa- 
ratus protection level specified by the apparatus pro- 
tection data and the medium protection level which is 
specified by the medium protection data 55 

Fig. 4 shows three examples of how the appara- 
tus protection level can be assigned. In the first ex- 
ample, the apparatus protection level is preset in ac- 



cordance with the country in which the reproduction 
apparatus is to be used. If the reproduction apparatus 
is to be used in the U.S.A. for example, then it is pos- 
sible that the apparatus protection level could be set 
to a low value such as 1 . In the case of a reproduction 
apparatus which is to be used in other parts of the 
world, such as Europe, Japan and Taiwan, which 
have varying degrees of restrictions on video soft- 
ware, the apparatus protection level could be set to 
higher values, as illustrated. In that way, video 
scenes which are not permissible in one country can 
be automatically eliminated (partially or completely), 
e.g. by insertion of mosaic pattern regions in the re- 
sultant display picture, by using the apparatus protec- 
tion level and medium protection level in combination 
as described hereinafter. 

With the second example in Fig. 4, the apparatus 
protection level is predetermined in accordance with 
the type of person who is expected to use the repro- 
duction apparatus. If the reproduction apparatus is to 
be used only by adults, for example, then the appa- 
ratus protection level can be set at a low value such 
as 1. If the reproduction apparatus will be used by 
children, the apparatus protection level can be set to 
a high value such as 4. In that way, video scenes or 
audio content which are considered unsuitable for 
children can be partially or completely restricted from 
being reproduced. 

With the third example in Fig. 4, the protection 
level that is set by the apparatus protection data is 
predetermined in accordance with the applications for 
which the reproduction apparatus will be used. For 
example if the reproduction apparatus is to be sold to 
the public, then the apparatus protection level can be 
set to a value such as 1 or 2, whereas if the reproduc- 
tion apparatus is intended to be used for demonstra- 
tion purposes in a shop, then the apparatus protec- 
tion level can be set to a different value, i.e. 3 or 4, 
and the apparatus of Fig. 1 controlled such that only 
certain scenes which should be of interest to possible 
customers of the shop will be displayed. In that way, 
the apparatus protection level can be set in accor- 
dance with the application objectives of the reproduc- 
tion apparatus. 

The overall features of reproduction protection 
will now be described, referring to Fig. 1. Firstly, data 
recorded on the CD 1 are read out, as an input signal 
to the demultiplexer 10. The recorded data on the CD 
1 consist of the compressed encoded main data (i.e. 
compressed encoded video and audio data) which 
are multiplexed with the medium protection data. The 
demultiplexer 10 separates the compressed encoded 
main data from the medium protection data, and sup- 
plies the medium protection data to a medium protec- 
tion signal detection section 11 while supplying the 
compressed encoded main data to a video decoder 
section 15. As described hereinabove, the medium 
protection data may inherently specify protection 
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position information, or may include explicit protec- 
tion position information. The medium protection sig- 
nal detection section 11 serves to detect the protec- 
tion position information, and generates a corre- 
sponding protection position signal, which indicates 5 
those portions of the main data to which the medium 
protection data applies (e.g. specific video signal 
frames, and/or block regions within specific frames). 
The protection position signal is supplied to a protec- 
tion control signal generating section 14. The medium 10 
protection signal detection section 11 is further re- 
sponsive to the medium protection data for generat- 
ing a corresponding medium protection signal, which 
expresses the medium protection level and is sup- 
plied to a final protection level determining section 13. 15 

The final protection level determining section 13 
basically consists of a matrix ROM in this embodi- 
ment, i.e. a ROM which stores a pattern of relation- 
ships between respective combinations of medium 
protection levels and apparatus protection levels and 20 
resultant final protection levels. The operation of the 
matrix ROM will be described referring to the matrix 
diagram of Fig. 2, which shows an example of how the 
contents of that ROM are read out in response to com- 
binations of medium protection level and apparatus 25 
protection level values. There are five possible values 
(designated as A to E respectively) for the final pro- 
tection level, successively increasing in degree of re- 
production limitation in the sequence A, B, C, D, E. 
Fig. 2 shows an example of various values of the final 30 
protection level which are determined by respective 
combinations of values of the medium protection level 
and apparatus protection level, i.e. the values in the 
range A to E which are located at respective intersec- 
tions between rows and columns of the matrix in Fig. 35 
2. Thus for example if the medium protection level is 
4 and the apparatus protection level is 2, then the fi- 
nal protection level will be B. 

It is necessary to clearly distinguish between the 
ROM of the apparatus protection signal generating 40 
section 12 and the matrix ROM of the final protection 
level determining section 13. The contents of the 
ROM of the apparatus protection signal generating 
section 12 can be set in accordance with the require- 
ments for a particular reproduction apparatus, where- 45 
as the contents of the matrix ROM of the final protec- 
tion level determining section 13 will in general be 
common to a large number of reproduction apparatus 
units. 

The final protection level determining section 13 50 
generates an output signal, referred to as the final 
protection level signal, which expresses the final pro- 
tection level that has been determined, and supplies 
that signal to the protection control signal generating 
section 14. In response to that signal, and the protec- 55 
tion position signal, the protection control signal gen- 
erating section 14 generates a signal referred to as 
the protection control signal, which is supplied to con- 



trol a section which will be referred to as the video de- 
coder section 15. For simplicity of description, only 
video signal reproduction will be considered at this 
stage, and the video decoder section 1 5 should be un- 
derstood as a section which converts the com- 
pressed encoded video data (main data) from the de- 
multiplexer 10 to a standard (analog) video signal. As 
the stream of compressed encoded main data flows 
into the video decoder section 15 from the demulti- 
plexer 10, the protection control signal controls the 
video decoder section 15 such as to apply reproduc- 
tion protection in accordance with the final protection 
level values, at the respective positions within that 
data flow which are specified by the protection posi- 
tion information. The video decoder section 15 there- 
by produces an output video signal which will result 
in video pictures in which reproduction of the main 
(video) data is limited in accordance with the final pro- 
tection level values. As will be understood from the 
above, the final protection level values may change 
from frame to frame of the video signal, in accor- 
dance with changes in the medium protection level. 

Af irst example of limitation of reproduction in ac- 
cordance with the final protection level will be descri- 
bed, which is implemented by controlling the expan- 
sion and decoding of the main data by the video de- 
coder section 15. The example will be described re- 
ferring to the embodiment of Fig. 5, in which the re- 
production apparatus is again a CD playback appa- 
ratus, designated by numeral 3. Only the operation 
with regard to the video data of the main data from the 
CD 1 will be described. In Fig. 5, a specific configur- 
ation for the video decoder section 15 of Fig. 1 is 
shown, made up of a variable-length decoding sec- 
tion 15a, a dequantizer section 15b, an inverse trans- 
form section 15c and a video reproduction control 
section 1 5d, with the compressed encoded video data 
being supplied from the demultiplexer 10 to the vari- 
able-length decoding section 15a and with the final 
output (analog) video signal being produced from the 
video reproduction control section 15d. In this em- 
bodiment, the video data have been recorded on the 
CD 1 after being subjected to compression by dis- 
crete cosine transform processing, and reproduction 
limitation is controlled by controlling the accuracy of 
inverse DCT (discrete cosine transform) processing 
which is effected by the inverse transform section 
15c. The protection control signal which is produced 
from a protection control signal generating section 
14a and supplied to control the inverse transform 
section 15c is derived based on the medium protec- 
tion data and apparatus protection data, in combina- 
tion, as described above for section 14 in Fig. 1, i.e. 
the protection control signal applies control in accor- 
dance with the final protection level. 

The demultiplexed compressed encoded video 
data read from the CD 1 are subjected to variable- 
length decoding in the variable-length decoding sec- 
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tion 15a, and then to dequantization in the dequantiz- 
er section 1 5b. The resultant compressed data are 
then subjected to inverse DCT processing in the in- 
verse transform section 1 5c, with the transform proc- 
essing being selectively modified in accordance with 5 
the protection control signal. The resultant decom- 
pressed data are then processed in the video repro- 
duction control section 15d to obtain the final output 
videosignal. The effect of reproduction limitation con- 
trolled by the protection control signal acting on the to 
inverse transform section 15c is to selectively pro- 
duce a degree of blurring or formation of a mosaic pat- 
tern within the pictures which are displayed using the 
final output video signal. Such a degree of blurring will 
be referred to as the visibility grade. An example of 15 
the relationship between the visibility grade and the 
final protection level values A to E (which are deter- 
mined by the protection control signal generating sec- 
tion 14a as described hereinabove, and are ex- 
pressed by the protection control signal) is shown in 20 
the leftmost column of Fig. 6. If the protection level is 
A, i.e. minimum limitation of reproduction of the video 
data, then the protection control signal is set to a state 
whereby it does not affect the operation of the inverse 
transform section 15c. If the protection level is B, then 25 
the protection control signal controls the inverse 
transform section 15c such as to operate on a block 
size of 8 x 8 picture elements (i.e. the same block size 
which was utilized in the original DCT processing), us- 
ing the DC component value for each block, but using 30 
only two of the AC transform coefficients, with the 
values of all of the other transform coefficients being 
forcibly set to zero. This will result in a substantial low- 
ering of resolution of a display picture that is produced 
based on the output video signal. If the protection lev- 35 
el is C, then the protection control signal controls the 
inverse transform section 15c such as to operate on 
a block size of 8 x 8 picture elements of a video signal 
frame, using only the DC component for each block, 
(i.e. the DC component is the only transform coeffi- 40 
cient used). In this case, since all of the picture ele- 
ments within an 8 x 8 picture element block will have 
identical video signal values, this will result in a mo- 
saic pattern being formed in the finally obtained pic- 
ture. If the protection level is D, then the protection 45 
control signal controls the inverse transform section 
15c such as to operate on a block size of 16 x 16 pic- 
ture elements, using only the DC component values. 
This will again result in a mosaic pattern being 
formed, in which the blocks of the pattern are of larger so 
size then for the case of protection level C, i.e. a mo- 
saic pattern of macroblocks is formed, thereby further 
degrading the degree of visibility of the resultant pic- 
ture. If the protection level is E, then the video data 
obtained from the inverse transform section 15c are 55 
replaced by different video data (produced from a 
source not shown in the drawing), which are produced 
from the video reproduction control section 15d as 



the final video signal, and which will produce a pre- 
determined picture or pictures. Such a predetermined 
picture might for example display a warning message 
concerning copyright protection. 

With the MPEG1 algorithm, a block size of 8 x 8 
picture elements is used in the DCT processing. The 
transformed block is expressed by a DC component 
(i.e. DC coefficient) and a plurality of coefficients (the 
AC coefficients) which represent signal level values 
at respectively different successively increasing fre- 
quencies. Thus if for example the inverse transform 
section 15c is controlled such that only the DC coef- 
ficient and the two lowest-frequency AC coefficients 
are used, in the inverse DCT operation for each block, 
then a specific reduction in resolution of all (or a spe- 
cific part) of the resultant display picture can be ach- 
ieved in a very simple manner. 

Similarly if only the DC component for a block is 
used in the inverse DCT processing, with all of the AC 
coefficients set to zero, then all of the signal level val- 
ues for the picture elements of a block will be set to 
an identical value, in the resultant video signal ob- 
tained from the inverse DCT operation. Hence, a mo- 
saic pattern can very easily be formed in the resultant 
picture that is obtained using the final output video 
signal. Moreover if, for each of respective 16x 16ele- 
ment macroblocks (i.e. each consisting of four 8x8 
picture element blocks), only the DC coefficient for a 
specific one of the 8 x 8 element blocks is used (for 
example, the DC coefficient for the upper leftmost 
one of the 8 x 8 element blocks) in the inverse DCT 
processing for all of the four 8x8 element blocks con- 
stituting the 16 x 16 element macroblock, with all of 
the AC coefficients set to zero, then a mosaic pattern 
will be formed which is substantially coarser than the 
mosaic pattern which is formed by using the 8 x 8 ele- 
ment blocks. 

It can thus be understood that with the above em- 
bodiment of the invention, applied to video data which 
have been subjected to high-efficiency compression 
encoding using a data transform operation, stepwise 
changes in a degree of restriction of reproduction of 
the video data can easily accomplished by effecting 
stepwise changes in a degree of resolution of a finally 
obtained picture, or in a portion of that picture, and 
that such stepwise changes in resolution can be easi- 
ly controlled in accordance with the final protection 
level which has been established based on the me- 
dium protection data and apparatus protection data. 
In particular, when such control is applied to the in- 
verse DCT processing, it is possible to easily effect 
stepwise changes in the visibility grade, i.e. in the pic- 
ture resolution, through use of unit blocks of picture 
element values which are basic to the transform proc- 
essing. Such a type of control of the visibility grade, 
operating within each frame of the video signal, can 
be considered as applying protection in a (2-dimen- 
sional) spatial domain. 
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With a video data encoding method such as the 
DCT method, the output digital signal that is produced 
from the inverse DCT circuit consists of sequential 
sets of data, each consisting of successive picture 
element values for the respective picture elements of 5 
a unit block (e.g. a block of 8 x 8 picture elements) of 
a video signal frame. In order to convert such a digital 
signal into a normal digital video signal, it is neces- 
sary to first temporarily store the data produced from 
the inverse DCT circuit in a video memory (e.g. a 10 
frame memory), then to read out the video data in the 
correct sequence (i.e. as successive picture element 
values in successive picture scanning line intervals). 
That operation is the basic function of the video repro- 
duction control section 1 5d in Fig. 5. Fig. 7 shows an- is 
other embodiment of the invention, in which control 
for reproduction protection is applied to the video data 
which have been produced from the inverse trans- 
form section 15c, i.e. in which control by the protec- 
tion control signal in accordance with the final protec- 20 
tion level is applied to a video reproduction control 
section which is configured such as to respond appro- 
priately to the protection control signal, and is desig- 
nated as 15d\ Apart from this feature, the configura- 
tion and operation of this embodiment is identical to 25 
that of Fig. 5 described above. The video reproduction 
control section 1 5d' includes a frame memory, into 
which output data from the inverse transform section 
i15c are temporarily written, and then read out in the 
appropriate sequence as described above, to obtain 30 
the final output video signal. 

In this embodiment, the degree of reproduction 
limitation is controlled by "thinning out" frames of the 
video data that are used to form the final output video 
signal, with the degree of "thinning out" being deter- 35 
mined by the final protection level. That is illustrated 
by the central column in Fig. 6, in which such a type 
of control is referred to as time domain protection. In 
the example of Fig. 6, when the final protection level 
is A, then all of the frames of video data which are sue- aq 
cessively written into the frame memory of the video 
reproduction control section 15d' are used to form the 
final output video signal. If the final protection level is 
B, then the protection control signal from the protec- 
tion control signal generating section 14b controls the 45 
video reproduction control section 15d' such that only 
one out of every 15 frames of video data supplied 
from the inverse transform section 15c is used to form 
the final output video signal. Specifically, one out of 
every fifteen frames of video data from the inverse so 
transform section 15c is held stored in the frame 
memory of the video reproduction control section 
15d' for fifteen successive frame periods, and is re- 
petitively read out during that time, to form the final 
output video signal. Thus a type sample-and-hold op- 55 
eration is performed using the frame memory in the 
video reproduction control section 15d\ whereby the 
finally obtained picture will change once in every 0.5 



seconds. If the final protection level is C, then the vid- 
eo reproduction control section 15d' is controlled 
such that the contents of the frame memory are up- 
dated only once in every 60 frame periods, i.e. the fi- 
nally obtained picture will change only once in every 
2 seconds. If the final protection level is D, then only 
the video data of certain specific frames (or one spe- 
cific frame) are written into the frame memory of the 
video reproduction control section 15d* and read out 
to obtain the final output video signal. In that way, for 
example, only a portion of the video data (e.g. a por- 
tion which is not subject to copyright protection) will 
be displayed. If the protection level is E, then the vid- 
eo data for a predetermined picture are written into 
the frame memory of the video reproduction control 
section 15d' and repetitively read out, to display only 
that predetermined picture, which can be for example 
a warning message concerning copyright protection. 

Alternatively, control of the degree of reproduc- 
tion limitation can be performed by arranging that the 
protection control signal from the protection control 
signal generating section 14b acts on the video repro- 
duction control section 1 5d' such as to vary (in accor- 
dance with the final protection level) the number of 
gradations provided by each video data sample, i.e. 
to vary the number of amplitude levels that can be ex- 
pressed by each sample. That can be performed by 
setting one or more low-order bits of each data sam- 
ple to a fixed value, e.g. 0. For example if the LSB is 
always set to 0, then the number of possible grada- 
tions is reduced by half, and a corresponding lowering 
of resolution of the finally obtained display picture is 
achieved. The bits in each digital data sample which 
are not fixed in that way will be referred to in the fol- 
lowing as the effective bits of the sample. Such gra- 
dation control based on the numbers of effective data 
bits is illustrated by the right-side column in Fig. 6. In 
that example, if the final protection level is A, then the 
protection control signal from the protection control 
signal generating section 14b has no effect on the op- 
eration of the video reproduction control section 15d', 
so that each video data sample used to form the out- 
put video signal has the standard number of effective 
bits, i.e. 8 bits. If the final protection level is B, then 
the protection control signal controls the video repro- 
duction control section 15d' such that the number of 
effective bits/sample of the output video signal is re- 
duced to 4 (i.e. by rounding-off the low-order 4 bits to 
zero). If the final protection level is C, then the protec- 
tion control signal controls the video reproduction 
control section 1 5d r such that the number of effective 
bits/sample is 2 (i.e. all except the two high-order bits 
are set to zero), so that the picture resolution is fur- 
ther degraded. Similarly, if the final protection level 
is D, then the video reproduction control section 
15d* is controlled such that the number of effective 
bits is reduced to 1. If the protection level is E, then 
the video data for a predetermined picture are written 
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into the frame memory of the video reproduction con- 
trol section 15d' and repetitively read out as the final 
output video signal, to display only that predeter- 
mined picture. 

It would be equally possible, as indicated by the 5 
broken-line connection from the protection control 
signal generating section 14b to the dequantizer sec- 
tion 15b in Fig. 7, to arrange that the protection con- 
trol signal from the protection control signal generat- 
ing section 14b acts on the dequantizer section 15b 10 
such as to vary (in accordance with the final protec- 
tion level) the number of effective bits of each output 
datum from the dequantizer section 15b. That will 
provide a similar effect to that described above for the 
case in which control is effected through the video re- 15 
production control section 15d\ 

Another method which may be used to control the 
degree of reproduction limitation is to apply the pro- 
tection control signal from the protection control sig- 
nal generating section 14b such as to control the va- 20 
riable-length decoding section 15a. In that case, the 
protection control signal is arranged to act on the va- 
riable-length decoding section 15a such that, as the 
protection level is increased from A to E, data having 
a long code length are set to zero, i.e. are ignored. 25 
This will result in a lowering of resolution in the final 
picture that is obtained from the output video signal. 

It should be noted that reproduction limitation 
control can be executed by a combination of control 
acting along the time axis and control acting in a spa- 30 
tial domain (i.e. within individual frames). That point 
is illustrated conceptually in Fig. 8, in which succes- 
sive vertical lines 20 represent sequential frames of 
the video signal that is recorded on the CD 1. (For 
simplicity of description, it will be assumed that the fi- 35 
nal protection level is identical to the medium protec- 
tion level). Together with each video signal frame data 
portion on the CD 1 , a medium protection data portion 
is recorded, which may include position information 
specifying a region within the frame within which dis- 40 
play resolution is to be lowered, to a degree that is in 
accordance with the final protection level. In this ex- 
ample there are two possible basic display conditions 
for each frame, i.e. non-display or display (with one 
or more degraded resolution regions possibly being 45 
formed). To achieve this, the medium protection data 
assigned to each frame includes a 1-bit flag, whose 
1 or 0 logic state designates either display or non-dis- 
play for the frame. If that flag bit indicates that none 
of the frame is to be displayed, the condition is indi- 50 
cated by a V symbol in Fig. 8, while if the flag bit in- 
dicates that the frame is to be completely or partially 
displayed, that condition is indicated by a V symbol 
in Fig. 8. In the example of Fig. 8, a "o" condition is 
specified for each of the ten consecutive frames des- 55 
ignated as F A , indicating that each frame is to be dis- 
played. In addition, the medium protection data of 
each of these frames includes position information for 



a degraded resolution region. The resultant display 
picture is designated by numeral 21, containing a de- 
graded resolution region 22, which is rectangular and 
is shown as a hatched-line region. The degraded re- 
solution region 22 is formed by a plurality of 16 x 16 
element macroblocks, and for each of the frames F A , 
the corresponding position information in the medium 
protection data specifies two addresses of macro- 
blocks (designated as 22a and 22b, located at the up- 
per left-side and lower right-side corners of the mo- 
saic region 22) within the frame, to thereby specify 
the position and size of a rectangular region which is 
the degraded resolution region 22. 

Similarly, a set of four successive frames F B is 
each to be displayed, but with a degraded resolution 
region formed in the final display picture, as indicated 
by numeral 24. In this case the degraded resolution 
region is formed of two adjoining rectangular regions, 
so that it is necessary for the position information in 
the medium protection data to specify the positions of 
two pairs of macroblocks within the frame, i.e. the pair 
of addresses of macroblocks 24a, 24b and the pair of 
addresses of macroblocks 24c, 24d in Fig. 8. 

It can thus be understood that in this case, repro- 
duction protection is applied by a combination of con- 
trol with respect to the time axis, and control with re- 
spect to (2-dimensional) space within each frame. It 
can be further understood that the invention enables 
extremely precise control of reproduction limitation, 
which is determined in accordance with the final pro- 
tection level. 

With data transmission in accordance with the 
MPEG1 system (i.e. based on the ISO-11 172-3 stan- 
dards), data are transmitted as successive packs of 
data, which are time-division multiplexed, as illustrat- 
ed by the data flow 40 shown in Fig. 9. Each pack is 
made up of a leading portion such as the portion 41, 
which contains information including a pack start 
code and a stream identifier which distinguishes the 
data conveyed by that pack from that of other packs 
(e.g. to distinguish between video, audio or other 
data), and a main data portion such as portion 42. In 
this example each main portion consists of either 
compressed encoded video data such as portion 42, 
encoded audio data such as portion 43, or protection 
data such as portion 44. In this example it will as- 
sumed that protection of the form shown in Fig. 8 is 
applied to the video data, so an individual protection 
data portion may be assigned to each of a plurality of 
video signal frames, i.e. video data frames can be 
conveyed by respective packs, each preceded by a 
protection data pack. In that case, each protection 
data pack in the example of Fig. 9 consists of a 3-bit 
portion which specifies the medium protection level, 
a 1-bit frame flag specifying whether or not the frame 
is to be displayed (as described above for Fig. 8), a 
portion which specifies the number of macroblock 
start/end address pairs (to be utilized when at least 
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one degraded resolution region is to be formed within 
the frame, e.g. as for each of the frames F A and F B in 
Fig. 8) t followed by the pairs of macro block start/end 
addresses (e.g. the pair of addresses of macroblocks 
24a, 24b, then the pair of addresses of macroblocks s 
24c ( 24d, for each of the frames F B in the example of 
Fig. 8). 

Fig. 10 shows a specif ic internal configuration for 
the video reproduction control section 15d' of the em- 
bodiment of Fig. 7. In Fig. 10, the output data from the 10 
inverse transform section 15c are supplied via a line 
50 to a gradation control section 51 , which is control- 
led by one of two protection control signals that are 
generated from the protection control signal generat- 
ing section 14b, and resultant output data from the 15 
gradation control section 51 are transferred through 
a switch 52, which is controlled by the other one of the 
protection control signals. Data transferred through 
the switch 52 are written into a frame memory 53, and 
are subsequently read out from the frame memory 53 20 
in the appropriate sequence to constitute successive 
frames of the original video signal. The digital video 
signal thereby produced from the frame memory 53 
is supplied to a digital/analog converter 54, to obtain 
an analog video signal as the final output signal. 25 

So long as the switch 52 is held closed, the con- 
tents of the frame memory 53 will be completely up- 
dated once in each frame period of the video signal, 
so that data of a new frame will be sequentially read 
out from the frame memory 53. However if the switch 30 
52 is held closed during an integral number of frame 
intervals, then the most recently stored contents of 
the frame memory 53 will be repetitively read out dur- 
ing each of these frame intervals, i.e. the last frame 
will be continuously outputted. It will thus be apparent 35 
that this circuit can implement the time-axis protec- 
tion operation described above on successive 
frames, if the switch 52 is controlled in accordance 
with the status of the frame bit that is contained in the 
medium protection data. 40 

The gradation control section 51 operates on 
each digital video signal sample (in general, each 8- 
bit datum) that is supplied from the inverse transform 
section 15c, to set the low-order bits of each sample 
in accordance with the final protection level. For ex- 45 
ample referring to the right-side column in Fig. 6, if the 
final protection level is B, then the gradation control 
section 51 sets all of the four low-order bits of each 
sample to a predetermined value, e.g. 0. If the protec- 
tion level is D, then all of the seven low-order bits of so 
each sample are set to 0. 

If reproduction restriction is to be applied within 
a video signal frame, then the protection control sig- 
nal generating section 14b responds to the protection 
position signal such as to apply the above-mentioned 55 
protection control signal to the gradation control sec- 
tion 51 during one or more specific time intervals 
within the corresponding frame interval, with each of 



these specific time intervals being determined based 
on one of the macroblock start/end address pairs 
which are shown in Fig. 9, described above. In that 
way, reproduction limitation can be applied within 
specific regions of a frame, as illustrated in Fig. 8, i.e. 
the spatial -domain protection operation described 
above can be applied. 

It will be understood that in practical terms, each 
"start address" will define a time-axis position, within 
a frame period, of the data sample corresponding to 
an uppermost left-side pixel of a rectangular region 
within the frame, while the "end address" similarly de- 
fines the position of a data sample corresponding to 
a lowermost right-side pixel of that region. Such time 
relationships can be readily established by well- 
known techniques for operating on a digital video sig- 
nal, so that detailed description is omitted. 

In the above embodiments, only reproduction 
protection of video data has been described. Fig. 11 
shows another embodiment of the invention, in which 
reproduction protection of both audio and video data 
is applied. Only the points of difference between this 
embodiment and previous embodiments will be de- 
scribed. A CD reproduction apparatus 5 of this em- 
bodiment differs from that of Fig. 7 by including cir- 
cuits for decoding and dequantizing an encoded dig- 
ital audio signal that has been recorded on the CD 1, 
by an audio decoding section made up of a variable- 
length decoding section 16a, a dequantizer section 
16b, a sub-band combining section 16c and an audio 
reproduction control section 16d. The compressed 
encoded audio data are separated from the video and 
protection data contained in the input data stream, by 
the demultiplexer 10, and are supplied as input data 
to the variable-length decoding section 16a, with an 
output audio signal being produced from the audio re- 
production control section 16d. This embodiment fur- 
ther differs from that of Fig. 7 in that the protection 
control signal generating section 14c of this embodi- 
ment produces not only a first protection control sig- 
nal which acts on either the video reproduction con- 
trol section 15d' or dequantizer section 15b to apply 
video signal reproduction protection by varying the 
number of bits per datum, as described hereinabove 
for the protection control signal of the embodiment of 
Fig. 7, but also a second protection control signal 
which acts on the audio reproduction control section 
16d or dequantizer section 16b to apply audio signal 
reproduction protection, as described in the following. 
For simplicity of description, it will be assumed that 
the second protection control signal is produced in 
accordance with the final protection level that is de- 
rived for reproduction protection of the the video data, 
as described hereinabove. However in general, sep- 
arate medium protection levels and separate appara- 
tus protection levels would be specified for the video 
and audio data, i.e. to obtain separate final protection 
levels for video and audio data. 



10 



19 



EP 0 668 695 A2 



20 



Fig. 12 is a table illustrating three possible meth- 
ods of applying audio signal reproduction protection 
with the embodiment of Fig. 1 1 . With each of the three 
examples shown in Fig. 12, five different audibility 
grades can be selected for the output audio signal 5 
produced from the audio reproduction control section 
16d, in accordance with the final protection level, to 
effect audio signal reproduction protection. Firstly, 
the method illustrated by the leftmost column in Fig. 
12 will be described. In this case, audio signal re pro- 10 
duction protection is applied by selectively restricting 
the bandwidth of the output audio signal produced 
from the audio reproduction control section 16d in ac- 
cordance with the final protection level. If MPEG 1 au- 
dio signal compression is used, then assuming a sam- 15 
pling frequency of 48 KHz, a bandwidth of 24 KHz is 
available for the output audio signal. In this example, 
if the final protection level is A, then no bandwidth re- 
striction is applied, i.e. the audio bandwidth is 24 KHz. 
If the final protection level is B, then the audio signal 20 
bandwidth is restricted to 1 8 KHz, if the protection lev- 
el is C the bandwidth is restricted to 12 KHz, if the pro- 
tection level is D the bandwidth is restricted to 6 KHz, 
and if the protection level is E then no audio output 
signal is produced. 25 

Since MPEG1 audio compression utilizes sub- 
band encoding with 32 bands, such bandwidth restric- 
tions can be effected by causing the second protec- 
tion control signal to act on the dequantizer section 
16b such as to set the inverse quantization values 30 
corresponding to certain high-frequency bands to 
zero. Thus, audio reproduction protection by band- 
width control can be easily implemented. 

A second method of audio signal reproduction 
protection will be described referring to the central 35 
column in Fig. 12. In this case, time-axis protection is 
applied, by "thinning-out" of audio signal sample val- 
ues that are supplied from the sub-band combining 
section 16c and used in the audio reproduction con- 
trol section 16d to obtain the output audio signal. In 40 
this example, if the final protection level is A, then all 
of the audio sample values are used in deriving the 
output audio signal. If the final protection level is B, 
then one in every two samples is held for two consec- 
utive sample periods, by a sample-and-hold circuit, 45 
i.e. only half of the total samples are used in deriving 
the output audio signal. If the protection level is C, 
then only one in every three samples is used in de- 
riving the output audio signal, i.e. one in every three 
successive samples is held for three consecutive so 
sample periods. If the protection level is D, then only 
samples which occur during a specified interval are 
used in producing the output audio signal. For exam- 
ple, this operation could be performed when only a 
specified part of the recorded audio signal is to be al- 55 
lowed (by the copyright owner) to be reproduced. If 
the final protection level is E, then no audio output sig- 
nal is produced. 



A third method of audio signal reproduction pro- 
tection will be described referring to the rightmost col- 
umn in Fig. 12. In this case, protection control is exe- 
cuted by effecting control of the number of gradation 
levels provided by the audio data samples, in a similar 
manner to that described hereinabove for the video 
data. Generally, a digital audio signal has 16 
bits/sample. When the final protection level is A, then 
all of these 16 bits are utilized, i.e. there is no limita- 
tion of audibility. If the final protection level is B, then 
the number of effective bits/sample is reduced to 12 
(i.e. the low-order 4 bits of each 16-bit sample are 
fixed at 0), causing a lowering of quality of the repro- 
duced audio signal. If the protection level is C, the 
number of effective bits is further reduced to 8, if the 
final protection level is D then the number of effective 
bits/sample is reduced to 4, and if the final protection 
level is E, then no audio output signal is produced. 

It can thus be understood that the invention en- 
ables precise limitation of reproduction of a recorded 
audio signal together with limitation of reproduction of 
the recorded video signal, in accordance with a com- 
bination of medium protection data and apparatus 
protection data. 

Fig. 13 shows an example of the internal config- 
uration of the audio reproduction control section 16d 
of this embodiment For the purpose of description, it 
is assumed that each of the above-mentioned three 
methods of protection control of the audio reproduc- 
tion control section 16d is utilized, although in prac- 
tice only one of these could be utilized. The circuit 
consists of a digital low-pass filter 61 which receives 
the output data samples from the sub-band combin- 
ing section 16c via an input line 60, a sample-and- 
hold circuit 62 which can be controlled to hold and out- 
put each data sample for a specific interval, a grada- 
tion control section 63 which effects the aforemen- 
tioned control of low-order bits of each audio data 
sample, to thereby control the gradation levels which 
can be expressed by each sample, a memory 64 for 
temporarily holding successive data samples, and a 
digital-to-analog converter 65 for converting the digi- 
tal audio data to an analog audio signal. The grada- 
tion control section 63 is controlled by a protection 
control signal to provide varying degrees of gradation 
in accordance with the final protection level that has 
been determined for the audio data, by setting vary- 
ing numbers of low-order bits of each 16-bit audio 
data sample to a fixed value as described above. 

As shown, the protection control signal can also 
be applied to control the sample-and-hold circuit 62, 
to effect the above-described method of reproduction 
protection control utilizing sample-and-hold process- 
ing of the audio data samples. Similarly, the protec- 
tion control signal can be applied to control the LPF 
61, to achieve reproduction protection control by 
varying the bandwidth of the audio signal. It will be 
clear that a simpler circuit configuration can be util- 
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ized that that shown in Fig. 13, ifonlyoneofthe above 
three methods of protection control is applied. 

In each of the embodiments described above, 
there is a fixed relationship pattern between combin- 
ations of the protection levels which can be ex- 
pressed by the medium protection data and the pro- 
tection levels which can be expressed by the appara- 
tus protection data, and the respective final protec- 
tion levels which are thereby obtained, i.e. the rela- 
tionship pattern which is stored in the matrix ROM of 
the final protection level determining section 13, an 
example of which is shown in Fig. 2. However in some 
cases there may be a requirement for enabling such 
a relationship pattern to be selected from a number 
of different relationship patterns, which have varying 
degrees of protection severity. Specifically, it may be 
advantageous to provide the reproduction apparatus 
with a switch which can be operated by the person 
who is in charge of the reproduction apparatus, such 
that the switch can be used to select from a plurality 
of different relationship patterns, so that the degree 
of reproduction protection can be flexibly determined 
by that person. In that way, the person in charge of the 
reproduction apparatus can ensure that the reproduc- 
tion protection will be appropriate for the viewing au- 
dience. For example, an adult can set the switch such 
as to ensure that unsuitable scenes cannot be viewed 
by any children who may use the reproduction appa- 
ratus. In that case, assuming for example that the re- 
lationship pattern which is the least severe is that 
shown in Fig. 2, the entire range of possible relation- 
ship patterns is illustrated in the table of Fig. 14. Here, 
for each combination of protection levels obtained 
from the medium protection data and apparatus pro- 
tection data, there is a corresponding range of one or 
more possible values of final protection level, with 
that range extending from a least severe value to the 
most severe value (i.e. protection level E). One meth- 
od of implementing such a capability would be to pro- 
vide a plurality of matrix ROMs (or to define a plurality 
of separate matrix regions in a ROM), for storing the 
respectively different relationship patterns. However 
an embodiment of the invention will now be described 
whereby such a capability can be easily implemented 
by a simple modification of any of the embodiments 
of the invention that have been previously described. 

The embodiment, which is a modification of the 
embodiment of Fig. 5, is shown in Fig. 15. The em- 
bodiment differs from that of Fig. 5 in being provided 
with a severity modification circuit 30 and a severity 
modification setting switch 31 . The severity modifi- 
cation circuit 30 is connected between the final pro- 
tection level determining section 13 and the protec- 
tion control signal generating section 14a t and func- 
tions to selectively modify each protection level value 
which is read out from the matrix ROM of the final pro- 
tection level determining section 13 (as described 
hereinabove for the embodiment of Fig. 5), and to 



supply a resultant modified final protection level to 
the protection control signal generating section 14a. 
The severity modification setting switch 31 can be 
adjusted by the person who is in charge of the CD 
5 player, to select one of five possible switch conditions 
which will be designated as P A to P E , respectively. 
The severity modification setting switch 31 is coupled 
to control the severity modification circuit 30 such 
that the severity modification circuit 30 executes pro- 
10 tection level modification in accordance with the spe- 
cific position at which the switch is set, as described 
in the following. 

The relationships between the five possible val- 
ues of the medium protection level (determined by the 
15 medium protection signal detection section 11 as de- 
scribed hereinabove) and the five positions P A to P E 
of the severity modification setting switch 31, are 
shown for each of the four possible values of the ap- 
paratus protection level (determined by the appara- 
20 tus protection signal generating section 12), in dia- 
grams (A) to (D) in Fig. 16. Referring first to diagram 
(A), if the switch position is P A , then the relationship 
between the medium protection level values, the ap- 
paratus protection level values and the final protec- 
25 tion level values is left unchanged from those of the 
corresponding column in Fig. 2, i.e. this setting of the 
severity modification setting switch 31 provides the 
least severe degree of reproduction protection. If the 
switch position is set to P B , then the least severe val- 
30 ue which can be taken by the modified final protection 
level becomes level B. That is to say, if a protection 
level A is established by the final protection level de- 
termining section 13, that is changed by the severity 
modification circuit 30 to a modified final protection 
35 level B. If the switch position is P c , then the least se- 
vere value of the modified final protection level is 
changed to C. If the switch position is P D , then the 
least severe value of the modified final protection lev- 
el is changed to D, and if the switch position is P E , 
40 then the modified final protection level is fixed as E. 

The same is true for each of the apparatus pro- 
tection level values 2, 3 and 4, as illustrated in dia- 
grams (B), (C) and (D) in Fig. 16, which correspond 
to the second, third and fourth columns in Fig. 2 re- 
45 spectively. 

It will be apparent that the severity modification 
circuit 30 can be easily configured using a logic cir- 
cuit, which implements a simple algorithm in accor- 
dance with the setting of the severity modification 
so setting switch 31, i.e. the algorithm would begin: 

[If the severity modification switch 31 is set at P A , 
transfer the protection level value established by the 
final protection level determining section 13 directly 
to the protection control signal generating section 
55 14a, as the final protection level. 

If the severity modification switch 31 is set at P B , 
and if the protection level value established by the fi- 
nal protection level determining section 13 is level A, 
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change that to level B and transfer to the protection 
control signal generating section 14a as the (modi- 
fied) final protection level. Otherwise, transfer the 
protection level value produced from the final protec- 
tion level determining section 13 unchanged, as the s 
final protection level. 

If the severity modification switch 31 is set at P Ci 
and if the protection level established by the final pro- 
tection level determining section 13 is level A or level 
B, change to level C, and transfer to the protection 10 
control signal generating section 14a as the final pro- 
tection level. Otherwise, transfer the protection level 
established by the final protection level determining 
section 13 unchanged, as the final protection lev- 
el ], and so on. 15 

Thus with this embodiment, if the severity modi- 
fication setting switch 31 is set to its least severe pos- 
ition (Pa), then the relationship pattern between com- 
binations of the medium protection level and repro- 
duction apparatus protection level values will be as 20 
shown in Fig. 2. If the severity modification setting 
switch 31 is set to the most severe position (P E ), then 
the relationship pattern will be such that the final pro- 
tection level will always be the highest level, i.e. level 
E. As the severity modification setting switch 31 is 25 
successively changed from positions P A to P E , the 
least severe degree of reproduction restriction (within 
the range of possible degrees of restriction which can 
be set by the final protection level) is increased to a 
more severe degree, by successive steps. 30 

For example if the apparatus protection level is 2 
and the medium protection level is 4, then the final 
protection level will be B. However by altering the set- 
ting of the severity modification setting switch 31 , the 
user can change the final protection level to a higher 35 
value, in the range B to E. Hence with this embodi- 
ment, although protection level values can be speci- 
fied by the manufacturer or copyright owner of the re- 
cording medium, and by the manufacturer or seller of 
the reproduction apparatus, the final degree of pro- 40 
tection can be determined by the person who is in 
charge of the reproduction apparatus. Such a feature 
is highly useful. 

As can be understood from the above description 
of embodiments, the invention enables a final protec- 45 
tion level to be established, for controlling reproduc- 
tion of recorded or transmitted video or audio signals, 
with that final protection level being determined 
based on a combination of protection levels which are 
respectively separately established by the manufac- so 
turer or copyright owner of recorded signals (or broad- 
caster of transmitted signals, or copyright owner of 
transmitted signal) and by the manufacturer or seller 
of the reproduction apparatus. The final protection 
level can be applied such as to achieve extremely pre- 55 
cise protection of reproduction, whereby for example 
specific frames of a video signal, and/or specific re- 
gions within a frame, can be protected by restricting 



reproduction, with the degree of restriction being va- 
riable in a stepwise manner. The invention can at the 
same time provide corresponding protection of an au- 
dio signal which is being reproduced in conjunction 
with a video signal. 

Although the invention has been described in the 
above with reference to a CD player apparatus, it will 
be understood that the invention is not limited in any 
way to such an apparatus, and is in general applica- 
ble to reproduction protection in any type of appara- 
tus which reproduces a recorded ortransmitted video 
and/or audio signal. 



Claims 

1. A reproduction protection method comprising: 

attaching medium protection data, which 
are specific to a data medium, to main data which 
represent an original signal, and conveying said 
medium protection data and main data by said 
data medium; 

supplying said main data and medium pro- 
tection data via said data medium to a reproduc- 
tion apparatus; 

generating apparatus protection data 
which are specific to said reproduction appara- 
tus, within said reproduction apparatus; 

determining a protection level by combin- 
ing the medium protection data and the appara- 
tus protection data; and 

controlling said reproduction apparatus to 
utilize said main data to reproduce said original 
signal in accordance with said protection level. 

2. A reproduction apparatus providing reproduction 
protection, for operating on main data which are 
conveyed by a data medium and represent an 
original signal and on medium protection data 
which are specific to said data medium and are 
conveyed by said data medium, the apparatus 
comprising: 

means for generating apparatus protec- 
tion data which are specific to said reproduction 
apparatus; 

means for defining a protection level 
based on said medium protection data and appa- 
ratus protection data in combination; and 

means for executing reproduction of said 
original signal by utilizing said main data, includ- 
ing means for selectively restricting said repro- 
duction in accordance with said protection level. 

3. A reproduction apparatus as claimed in claim 2, 
wherein the apparatus further includes: 

means (10,11) for detecting said medium 
protection data to obtain a medium protection sig- 
nal expressing said medium protection level; 
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said generating means comprises means 

(12) for generating an apparatus protection sig- 
nal expressing an apparatus protection level 
which has been assigned to said reproduction ap- 
paratus; 

said defining means comprises means 

(13) responsive to said medium protection signal 
and apparatus protection signal for determining a 
final protection level in accordance with a com- 
bination of said medium protection level and ap- 
paratus protection level, and generating a final 
protection level signal expressing said final pro- 
tection level. 

4. A reproduction apparatus providing reproduction 
protection, for operating on main data which are 
conveyed by a data medium and represent an 
original signal and on medium protection data 
which are specific to said data medium and are 
conveyed by said data medium, the apparatus 
comprising: 

means (10,11) for detecting said medium 
protection data to obtain a medium protection sig- 
nal expressing said medium protection level; 

means (12) for generating an apparatus 
protection signal expressing an apparatus pro- 
tection level which has been assigned to said re- 
production apparatus; 

means (13) responsive to said medium 
protection signal and apparatus protection signal 
for determining a final protection level in accor- 
dance with a combination of said medium protec- 
tion level and apparatus protection level, and 
generating a final protection level signal express- 
ing said final protection level; 

means (15) for utilizing said main data to 
execute reproduction of said original signal, in- 
cluding means (14) responsive to said final pro- 
tection level signal for selectively restricting said 
reproduction in accordance with said final protec- 
tion level. 

5. A reproduction apparatus according to claim 2, 3 
or 4, wherein said main data are conveyed by said 
data medium after having been compressed and 
encoded, wherein said reproduction apparatus 
includes means (15a, 15b, 1 5c) for decoding and 
means for decompressing said main data, and 
wherein said means for selectively restricting re- 
production of the original signal comprise means 
for controlling at least one of said decoding 
means and said decompressing means in accor- 
dance with said final protection level. 

6. A reproduction apparatus according to claim 5, 
wherein said main data comprise video data 
which are conveyed by said data medium after 
having been compressed by applying a transform 



operation upon each of fixed-size blocks of pixel 
values within each frame of a video signal, 
wherein said decompressing means includes 
means (15c) for applying an inverse transform 
5 operation, and wherein said means for selectively 

restricting reproduction of the original signal 
serves to selectively eliminate specific ones of a 
plurality of transform coefficients utilized in exe- 
cuting said inverse transform operation. 

10 

7. A reproduction apparatus according to any of 
claims 2 to 6, wherein said main data are con- 
veyed by said data medium after having been 
compressed, quantized and encoded, wherein 

15 said reproduction apparatus includes means 
(15b) fordequantizing said main data, and where- 
in said means for selectively restricting reproduc- 
tion of the original signal comprise means for con- 
trolling said dequantizing means in accordance 

20 with said final protection level. 

8. A reproduction apparatus according to any of 
claims 2 to 7, wherein said means for selectively 
restricting reproduction of the original signal 

25 comprise means (52, 62) for periodically omitting 

selected portions of said main data from use by 
said reproduction control means in reproducing 
said original signal. 

30 9. A reproduction apparatus according to claim 8, 
wherein each of said selected portions comprises 
at least one digital data sample. 

10. A reproduction apparatus according to claim 8 or 
35 claim 9, wherein said main data express a digital 

video signal, and wherein each of said selected 
portions comprises at least one video signal 
frame. 

40 11. A reproduction apparatus according to any of 
claims 2 to 1 0, wherein said means for selectively 
restricting reproduction of the original signal 
comprises gradation control means (51, 63) for 
selectively varying a number of signal amplitude 

45 gradations which can be expressed by each data 

sample of said main data. 

12. A reproduction apparatus according to any af 
claims 2 to 11 , wherein said means for selectively 

so restricting reproduction of the original signal 

comprises controllable digital low-pass filter 
means (61) for filtering said main data, to thereby 
controllably vary a bandwidth of a reproduced 
original signal obtained from said apparatus. 

55 

13. A reproduction apparatus according to any of 
claims 2 to 12, wherein said medium protection 
data specify a medium protection level and pro- 
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tection position information, and wherein said 
protection position information specifies a por- 
tion of said main data which is to subjected to re- 
production restriction in accordance with said fi- 
nal protection level. 5 

14. A reproduction apparatus according to claim 13, 
wherein said main data comprise a digital video 
signal, and wherein said protection position infor- 
mation specifies at least one region within each 10 
of a plurality of frames of said video signal. 

15. A reproduction apparatus according to any of 
claims 2 to 14, further comprising protection sev- 
erity modification means, operable for modifying 1 s 
said final protection level which is determined by 
said combination of medium protection data and 
apparatus protection data, to obtain a modified fi- 
nal protection level. 

20 

16. A reproduction apparatus according to claim 15, 
wherein said severity modification means com- 
prise a manually operable switch (31) provided on 
said reproduction apparatus, and severity modi- 
fication circuit means (30) coupled to said switch 25 
and coupled to receive a signal representing said 
final protection level, for modifying said final pro- 
tection level in accordance with a setting position 

of said switch and thereby producing an output 
signal expressing a modified final protection lev- 30 
el. 

17. A reproduction apparatus according to claim 16, 
wherein said final protection level has a value 
which defines one of a plurality of successively 35 
increasing degrees of restriction of reproduction 

of said original signal, extending between a mini- 
mum and a maximum degree of restriction, and 
wherein said severity modification means is re- 
sponsive to a change in said setting position of 40 
the switch for changing only said minimum de- 
gree of restriction. 

18. A data medium for transferring main data repre- 
senting an original signal to a reproduction appa- 45 
ratus, to reproduce said original signal by said re- 
production apparatus, wherein said data medium 
further transfers medium protection data which 

are specific to said data medium and wherein 
said reproduction apparatus generates appara- so 
tus protection data which are specific to said re- 
production apparatus, said medium protection 
data and apparatus protection data in combina- 
tion specifying a degree of restriction on said re- 
production of the original signal by said reproduc- 55 
tion apparatus. 



15 



EP 0 668 695 A2 



=> o <x: 

Q.UJZ 

I — o cd 

ZD 

o > co 



ocz 

LU O 
OO — 

ULlOl— 

ooo 

— LU LU 
>QCO 



o 
o 



o <c 

LU I — 

co <c 

CO o 
LU 

QCO 
Ct_ LU 
2 O 
O — 
O 



z 

O CO 



OO 
LUCE 
I — f— 
OZ 
OCO 
Q- O 

!*\ 



> OO 
N| qc ^ 



O <C 

OQC 



O LU 

— cd 

h- z 
O— JO 
LU <C — 
KZI — 
OCDU 

OC LU 

G- CO CO 



CO 

o 
a. 



o 



o cd 
or — 

Q- CO 



or 

LU 
X 




o 
o 



o 
or 



— <T 
Oh- 
LU <C 
SO 



o 

O _J 
LU 

Z 

o cd 
oc — 

CL. CO 



— LU 



CO 



o 
o 



o 
oc 



CD 

o — 

i^ — 
OS 
LU QC 
f— LU 
O K- 
OC LU 

a_o; 



■o 

ILU 
ICO 



O CD 
LU — 
SCO 



o 
o 



o 
or 

CO 



<cz 

Q_ CD 
O- — 

•<C CO 



O Z 

— O 

I 

Of— 
LU O 
V— LU 
Ot- 
OC LU 
CL. O 

z 

S-JO 
=3<< — 

— Zh 
O CD O 
LU — LU 
SCO CO 



— »o 
— 

Zh 
CD O 
— LU 

CO CO 

: CD 



CO O i 



<: o -< 

OC LU OC 
<C H- LU 

a. o z 
a. oc lu 
o_ cd 



16 



EP 0 668 695 A2 



FIG. 2 

REPRODUCTION APPARATUS 
PROTECTION LEVEL 
► STRONG 





1 


2 


3 


4 


1 


A 


A 


A 


A 


2 


A 


A 


A 


B 


3 


A 


A 


B 


C 


4 


A 


B 


C 


D 


5 


E 


E 


E 


E 



17 



EP 0 668 695 A2 



UJ 



o 



o 

OC 





oc 

ll 1 


OC 
1 1 i 


LO 


31 






1 


t 


















ixi 












O CD 




X 


OC o 






h- oc 






CO 






UJ CO 






oc* — 












LU LU 






1— 1— 








CO 


oc 


— OC 
OC LU 






1— cs 






CO O 












cc^ — 






UJ 






1— 






o 


CVJ 


cd 




o_ 


ccS: 












COUJ 






LU ^ 










LU 
LU 
OC 


REE 




U_ 


u_ 








O 2 


LU 




O 




1— o 


CO — 




z: =c — 


LU h- 


00(0 


OOI- 


—ISO 


Z CD 


— o 


CL, => LU 




OOCUJ 


1— 


LU . — 


LU 


<CiO 


GO GO h- 


CO Q- O 


XLUQC 


. -< 


<ooc 




CQ=D OC 


CQ O Q_ 



18 




19 



EP 0 668 695 A2 



^ 0<£ 
O.UJZ 
^QCD 
ZD 

o >co 



co 



T7 
LO 



i 



o o o 
o o cc — 

UJ OC h- I— 
d Q_ Z O 
— LU O UJ 
>QCOC0 



o 



o 

O CO 
P —I 

o o 



o z 

OCO 



LU OZ 
CO U_0 
QC CO — 

> <co 

ZOCUJ 
— H-CO 

— z 



_Q 



QC2 



O << 
UQC 



O LU 
— CD 



OCUO 
CC — LU 
COCO 



QC 
UJ 

rsj 



zo 
<c — 

a o 

LU LU 
O CO 



CO 

o 
a. 



o 



o 
cc 

a. 



CD 

CO 




o 



zr 1— 

LUCC< 
5Q.Q 



O 
I— 

O-J 
LU <C 
h- Z 
OO 
ac — 
a- co 



— LU 



X 



o 



o 
a. 



— z * — y 



13 *C 
CD 
CO 



CD 
O — 



OS 
LU QC 



0_0 Z 
O 

—J —I — 
<LUH 

z> o 

LULU 

U 1 CO 



o 
ac 

co 



-< — 1 

<2 

a. cd 
«cco 



— o 
I 

Uh 
LU O 
H- LU 
O I — 

ac lu 
a. o 

— 

— Zl— 

UJ — LU 
SCO CO 



-J o 

— 
z h- 

CD O 
— LU 
CO CO 

: CD 



co o ; 



<c o <c 
ac lu ac 

<CI— LU 

cu o z 
o. ac lu 
•< a- cd 



o 



20 



EP 0 668 695 A2 



ION 












EXAMPLE OF VISIBILITY 
GRADES, USING PROTECT 1 
BASED ON VIDEO DATA 
BIT-NUMBER CONTROL 
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EXAMPLE OF VISIBILITY 
GRADES, USING TIME-AXI 
PROTECTION CONTROL 
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EXAMPLE OF VISIBILITY 
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SPATIAL- DOMAIN 
PROTECTION CONTROL 
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